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ABSTRACT 

Many proposed solutions for preventing aircraft accidents in the 
U.S. NAVY have led to elimination of some of the obvious causal 
factors. Underlying factors related to Attack Carrier Operating methods 
and pilot performance are examined for aircraft accidents which occurred 
during deployments from 1962 through 1963. Variables derived from CVA 
operating schedules for the SIXTH and SEVENTH FLEETS are illustrated 
and compared. Conditions surrounding aircraft accidents, such as length 
of time on deployment, time at sea and in port, and pilot's experience 
are studied to determine similarities and differences in fleet operations. 
Computer programs are presented which were written to process and 
display the data contained in ship movement reports and aircraft accident 


reports. 
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Ie Introduction and ‘Suinmany. oa ante ee 

The study of aircraft accidents nat Sete ES result of attack carrier 
operations was suggested by the U. S. Naval Aviation Safety Center. The 
study is to be part of a proposed fleetwide study of accidents incident to 
all types of carrier operations, with intent to analyze the occurrence of 
accidents as related to differences in methods of operations. 

Attack carrier operations and their associated aircraft accidents during 
calendar years 1962 and 1963 form the basis for a comparison of the SIXTH 
and SEVENTH FLEETS. Variables were defined and calculated which per- 
tained to individual, ship, and fleet operational accidents with theintent 
to distinguish where possible between the fleets. 

In general, the SIXTH and SEVENTH FLEETS operated in a similar 
manner. The length of periods at sea for the two fleets was found to come 
from the same distribution. However, they were shown to differ in the 
length of periods spent in port. Accidents occurred in both fleets at ap- 
proximately a constant time rate, with the SEVENTH FLEET having a slightly 
higher rate since it had 1.6 more carriers deployed on the average than the 
SIXTH FLEET. No significant difference was found in the number of acci- 
dents per carrier operating days for the two fleets. The distribution of 
accidents during a deployment for the CVA's of each fleet was found to be 
the same, as was the distribution of time at sea prior to an accident. Each 
of the CVA's was found to operate in a manner consistent with its parent 
fleet. The percent of accidents encountered on deployment did not differ 
significantly within or between the two fleets. 

In this study the operational performance of the two fleets was found 
to be essentially the same, as was their safety performance. It is there- 
fore concluded that variables other than those analyzed in this study must 


be found to distinguish between the two fleets. 
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2. Data and Assuniction ed ee ae 

Data pertaining to each aircraft accident was supplied by the U. S. 
Naval Aviation Safety Center in the form of an IBM punch card deck con- 
sisting of three data cards per accident. The cards contain information 
coded in alphanumeric form which was transferred from the original Air- 
craft Accident Reports. The first two cards in each sequence contain 
general and supplementary information, a description of the accident and 
primary and secondary cause factors. The third card contains personnel 
statistics pertaining to the pilot and crew involved in the accident. Com- 
puter programs for processing and displaying this data are listed in Appendix 
Tl. 

Ship operating and employment schedules were obtained from 
COMNAVAIRLANT and COMNAVAIRPAC. In addition, microfilm containing 
individual ship movement reports were supplied by NASC. A method was 
developed for coding the operating status of a ship in such a way as to 
determine whether the ship was deployed, at sea or in port for each day 
in a desired time span. This served as input for a computer program to calcu- 
late variables related to the carrier's operating plan. This program is listed 
in Appendix II. 

Detailed operational data such as flight hours, carrier landings, etc., 
was available on OPNAV ZULU tapes for each aviation unit involved. How- 
ever, the format and content was Such that this information could not be 
utilized in the time allotted for this study. For further explanation, see 
Appendix I. 

In general, each of the variables to be analyzed in this study is ex- 
amined in three categories, (a) combined fleets, which includes all CVA's 
regardless of deployed status, (b) SIXTH FLEET, which is limited to those 
CVA's actually deployed or enroute to or from the Mediterranean area, and 
(c) SEVENTH FLEET, which also is iumited to thes? CVA's deployed or en- 
route to or from the SEVENTII FULET depioyment area. es ws 
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The FIRST and SEGC ND eLEEVS. are not categorized SO severa: reasons. 
Primarily, sufficient data was not availeole for Peete deere 
periods at sea and in port since much of this operation is on a local area 
basis, and the carriers do not submit movements reports. Also, much of 
the time is spent in training new personnel, on RAG qualifications and indi- 
vidual ship proficiency training. These conditions are not typical of a 
ready carrier on deployment. 

A deployment is assumed to begin when a carrier departs CONUS en- 
route to a forward area, and is terminated when the carrier returns to CONUS. 
Although not technically assigned to their deployed fleet while enroute, many 
CVA's conducted operations which were under conditions similar to deploy- 
ment, and analysis of the accidents occurring during these enroute opera- 
tions should be included for completeness. 

Variables related to in port/at sea schedules for the SIXTH and SEVENTH 
FLEETS were derived primarily from ship movement reports. Any deviation 
from a ship's schedule as recorded by these reports is not considered inthis 
study. Whenever a CVA was reported to be at sea, the assumption is made 
that flight operations were being conducted, since the available data does 
not permit a breakdown of the type of at-sea operations. When a shipleaves 
or enters a port such that more than half the day is available for operations, 
that day is counted as a day at sea, otherwise it is a day in port. 

Accidents involving more than one aircraft are counted as multiple ac- 
cidents only if the other aircraft were incident to flight. For example, an 
inflight collision involving two aircraft is counted as two accidents, whereas 
a landing accident which destroys other parked aircraft is counted as one 
accident. This assumption is justified since the aim of this study is to 


examine all aspects of accident occurrence and analyZe all the data pertinent 
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to any accident. In the casé of multipie accidents, daia related to all of 
the involved aircraft, pilots, ships and fleets must be considered. Under 
this assumption, the number of accidents per CVA will differ from the pub- 


lished values 2 


1VASC. U.S. Navy Aircraft Accident Statistics for the Calendar 
Year 1963: 47-48 
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3. Compositicn of thé Fleet¢. 

During calendar years 1962 and 1963 there were fifteen Attack Carriers 
in operation. Two additional carriers were operating as CVA's at the 
beginning of 1962 and were reclassified as CVS's during this period. The 


fleets were composed as follows: 


FIRST AND SEVENTH 

TICONDEROGA CVA 14 
LEXINGTON“ CVA 16 
HANCOCK CVA 19 
B. H. RICHARD CVA 31 
ORISKANY CVA 34 
MIDWAY CVA 41 
CORAL SEA CVA 43 
RANGER CVA 61 
KITTY HAWK CVA 63 
CONSTELLATION™ CVA 64 


2 
LEXINGTON departed FIRST FLEET in August 1962 for reclassification 
as CVS. 


3 CONSTELLATION departed Mayport in July 1962 for transfer to the 
PACIFIC FLEET. 
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SECOND and SIXTH 





INTREPID * CVA 11 
SHANGRI LA CVA 38 
ROOSEVELT CVA 42 
PORRESTAL CVA 59 
SARATOGA CVA 60 
INDEPEN DENCE CVA 62 
ENTERPRISE CVA 65 


The combined fleets will include all CVA's regardless of deployed status. 
The SIXTH FLEET and SEVENTH FLEET will include only those CVA's actually 


deployed or enroute to the deployed area as previously stated. 


4 INTREPID was reclassified as CVS 1l on 31 March 1962 
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4. Accident Occurrence with Time. 

Cumulative aircraft accidents were plotted as they occurred in time, 
using a two year time span beginning 1 January 1962. Fig. la is the plot 
for the combined fleets which shows that the occurrence of the 300 acci- 
dents without regard to deployed status is linear. Fig. lb, showing 70 
SIXTH FLEET accidents, and Fig. lc, showing 103 SEVENTH FLEET acci- 
dents, also indicate a linear rate of accident occurrence. 

The hazard function h(t) of an underlying probability density function 
f(t) describes the rate at which a device will fail provided it has not failed 
prior to atime t. The simplest form of the hazard function occurs when 
the failure rate is constant. It is shown in [{ 2] that 


f(t) 


n= Tene 


and 


f(t) = h(t) exp i i h(t) dt ] 
0 


Since the rate of aircraft accident occurrence is approximately constant 
for each of the categories, the hazard function is simply the slope of the 
line in Figs. la, lb, andlc. Denoting this slope by i , the underlying 


density function becomes 


f(t) = A} exp (-At) 
which is the well known exponential probability density function. The 
constant A is interpreted as the rate of accident occurrence and its 
reciprocal is the mean time to occurrence. 
An estimate of the true accident occurrence rate can be made from the 
available data as plotted. It is known that the limiting distribution of any 
reasonably behaving function of a sample mean is asymptotically normal as 


the sample size tends to infinity. Under this assumption, the maximum 
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likelihood estimator for the sample occurrence rate is normally distributed 
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about the true rate. Since the true variance for the estimator is not 
known, a confidence interval about the true mean can be obtained by 


using the quantity 


a 


t=yn-1(rA=A) 
S 


which has the t distributed with (n-1) degrees of freedom. i is the 
same mean, S is the sample standard deviation, \ is the true accident 


occurrence rate, and n is the number of accidents. Therefore 


h + t(—; n-1) 5 
2 n-} 





gives a (l-a) confidence interval for the true aircraft accident rate \. 

The calculations for the combined fleets reveal that the true accident 
occurrence rate, with 90% confidence, lies between .37 and .45 acci- 
dents per day. A region of the same confidence level for the SIXTH FLEET 
shows the true accident occurrence rate between .08 and .12 accidents 
per day. The 90% confidence region for the true rate in the SEVENTH 
FLEET is from .12 to .16 accidents per day. 

These accident occurrence rates for the SIXTH and SEVENTH FLEETS 
were compared in a two-tailed test of hypothesis to determine if signifi- 
cant difference existed between the two fleets. Fora .05 level of 
Significance, the results show a difference in performance. However, the 


results were not Significant at the .01 level. 


, GONFIDEN TIAL 


> 
) 
ad “ A ’ 9 
»>)) b , d ’ 


~~ 
- 
= 
~~ 
~~ ad 








CONFIDENTIAL. 


’ ’ ’ ’ ’ ’ » 3 ‘ ' 
} J ‘ ‘ } ’ 5 

’ ’ 1 i ’ i ’ » % ‘ 

’ ’ ‘ ’ y,. 3 ’ ‘ 

.) > 7 sled eee ob ech »r AAO seed ar ’ ; iL 





600 GOD COE G06 008 


if 


X = Scale 
Y = Scale 


Days x 100 
Accidents x 100 


it 


Fig. la. Cumulative accidents since 1 January 1962, Combined Fleets 
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X-Scale=Days x 100... | 


: Y-Scale=Accidents x 10 
/ 


Fig. lb. Cumulative accidents since 1 January 1962, 6th FLEET 
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X-Scale=Days x 100 : | ‘ 
Y~Scale=Accidents x 10 
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Fig. lc. Cumulative accidents since 1 January 1962, 7th FLEET 
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5. General Comparison of Deployed Fleet Operations 

Table 1 shows selected variables for the SIXTH and SEVENTH FLEETS 
which were computed from the ship movement reports. Carrier Operating 
Days is defined as the number of days at sea while deployed. Enroute or 
transit time is included in total deployed time to permit analysis of air- 
craft accidents which occurred during these periods. 

During calendar years 1962 and 1963, the SEVENTH FLEET suffered 
more aircraft accidents than the SIXTH FLEET. However, there were on 
the average 1.6 more CVA's operating with the SEVENTH FLEET, and the 
ratio of accidents to average number of deployed carriers shows the SIXTH 
FLEET with the higher rate. Other variables show that the SIXTH FLEET 
spent more time at sea per CVA on the average than did the SEVENTH 
FLEET, which may account for this difference. The ratio of accidents to 
carrier operating days indicates that the two fleets were very nearly the 
same. Since this ratio is a function of the number of CVA's deployed, the 
amount of time spent at sea and the number of accidents, it presents an 
effective measure of safety performance. This measure could be improved 
by uSing the number of days in which flight operations were actually con- 
ducted instead of Carrier Operating Days. The data available did not 
permit this breakdown. 

Fig. 2 is a plot of length of periods in port versus frequency for the 
two fleets. The SIXTH FLEET plot is rather uniform for periods of one to 
seven days with an average length of 4.38 days. The SEVENTH FLEET 
shows more variation with modes at four and seven days. The average 
stay in port was 6.49 days. 

Fig. 3 depicts length of at sea periods versus frequency. The major 
difference appears in periods at sea greater than nine days. The average 
length of time at sea for the SIXTH FLEET was 9.59 days. This figure was 
3.97 days for the SEVEN'3H)PUSET.: ‘++ 1.8 3 >) 0 pr 


5 
1 y 6 ) > 
» 


’ ; ; 
) > > ) ) > . >> ) ) ) 
) , ) $ » } } ’ y ; ~ 
ae! P Dee) ee eed 3 bi > bd » > CONFIDENTIAL 


aac oOnag coat fa ty fot (alae Cored fare Units e car i iG € i 
c € € ¢ t f c ¢ ts € ‘ a ar € c 
c G aad C foc € aoc oc cf ¢ € € coc € ¢ C 
¢ € € G € G ¢ iG aaar € € ¢ € ¢ ic 

(AL AUNT & aa coe’ it reer ore coceg ¢ € ree ree moc 1. fc foc 


—=- = =o =z EE ©« Ea» 
—_— me —- = = a> 
. 7 


a 


a 
a 


* <<a 
I 
ediineemneen anaes 





CONFIDENTIAL ° | 


It is not clear from Figs. 2vana 3 whether significant difference 
existed in the operating schedules for the SIXTH and SEVENTH FLEETS. 
The two-sample Kolmogorov-Smimov test, based on a diStribution-free 
Statistic D, tests the hypothesis that the two samples came from the 
Same population. [1 ]. The two functions are accepted under the null 
hypothesis as coming from the same distribution if D is less than the 
critical value determined for some level of significance. 

When the test was applied to the cumulative percentage distributions 
of length of periods at sea for the two fleets the maximum difference 
occurred at seven days giving a value for D of 16.9 percent. The critical 
value at the one percent level of significance was 19.0, indicating no 
difference in the distribution of length of at sea periods for the two fleets. 

For length of periods in port the critical value at the one percent 
Significance level was 19.7. The maximum difference in the cumulative 
percentage distributions was 21.8 which occurred for in port periods of 
eight days. Therefore the hypothesis that the two fleets had the same 


distribution for length of time in port must be rejected at this level. 
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Table 1 
SIXTH 

Number of Accidents 70.00 
Average number of CVA's 
deployed Zanoie 
Number of Accidents/average 
number of CVA's deployed 30a 
Carrier Operating Days 1189.00 
Days in Port 504.00 
Carrier Operating Days/Days 
in Port 2236 
Percent Time at Sea 7OmZS 
Percent time in Port 29.77 
Number of .Accidents/carrier 
operating days Ore 


14 


SEVENTH 


103.00 


Soa 


26.28 


1805.00 


1072.00 


62.74 


S70 


nO 
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X-Scale=Number of in port periods 


Y-Scale=Length of in port periods (days) 
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X-Scale=Number of ai sea vericds 
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Y-Scale=Length of at sea periods (days) 
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6. General Compariscn of Weploved ‘CVA Operations’. » yyy os : 

Variables-related to individual ship operations are contained in Table 2 
for the SIXTH FLEET and Table 3 for the SEVENTH FLEET. CVA 11 was de- 
ployed at the beginning of the test period, 1 January 1962, and was re- 
classified upon return to CONUS. All other ships completed at least one 
full deployment, and some were also deployed at the beginning or the end of 
the test period. This accounts for the differing values of Carrier Operating 
Days and days spent in port, 

The percentage of total accidents that occurred on deployment for the 
SIXTH and SEVENTH FLEETS were 60 and 56 respectively. A likelihood ratio 
test of these two Bernoulli populations can be used to test the null hypothe- 
sis that the two percentages did not differ significantly. [1]. Denoting the 
likelihood ratio by i , the quantity -2 log } has asymptotically the chi- 
square distribution with one degree of freedom. Application of the test 
showed the chi-square value to be .34. Since this is less than the critical 
value of .455 at the .5 level, the hypothesis is accepted that two fleets 
showed no significant difference in percent of accidents that occurred on 
deployment. 

The fraction of time spent at sea for each CVA was compared with the 
same frequency for its parent fleet using the likelihood ratio test. The 
results show that at a .1 level of significance, the time spent at sea by 


each CVA was consistent with its parent fleet as a whole. 
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ao o> Table,%, .,, Pe i ee 
> i ye OoOVA ; aice 5 eae: 

pt 38 42 59 60 62 65 
Carrier Operating 
Days 38 197 165 155 24) 193 200 
Days in Port 22 97 56 98 102 86 83 
Percent time 
at Sea 63:0" 070 74.7 20 70.3 69.2 TOT 
Percent time 
in Port 30.7 Soo7e Zon 27.2 29.7 30.8 LoS 
Number of 
Accidents while 
deployed 0 16 11 ll 14 8 10 
Number of 
Accidents/Carrier 
operating days .000 .0812 .0667 -O710. 20581 ).0415 20500 
Total Number 
of Accidents 0 ZS 18 23 18 E7 16 
Percent of 
Accidents that 
occurred on 
deployment 0 64.0 Giee 47 .8 7728 aja. \ O25 


38 , 2 3 v oo 30 3 >)» ) ) 


) »? 
» o>» oe . >»? 
a ) ) ) : 
) ) “ " o ’ ”? ron) 2 ) a 
) »>»? ) »>>»d ’ >? > ) CONFIDENTIAL 
) ’ ) ) ) » »?D , ) 
) ’ > 2 ’ > b> yo» SF ) 9) ) d , 


~~ = we 
oua { ‘ 
ae q Pi \.6 oe 


\ 
o 


” 
§ 





Contec: 


ad 
c 
\ 
eer 
u 
Wu 


f . 
wi Sew 
"3 “4 s 
= wee 
2 va — 
~~ 4 -~ 
a i) V4 
rt = 
fen, 
~~ 5 
~ ~~ 
—' =a? 
2 
3 
rae 
See 
ek 
a 
i. 
vont 
ad 
a =e 
C3 
(ons 
ce 
“5 


mt 
~ =. 
fe 2 
7 
nape 
i 2 
a a 
. =v 
=< ‘4 
~~ _ 
ro tot & 
t zs 
} Ja? 
yee yo 
on 
5 : 
oy 
- +s 
— _ 


-™ 
2 


geet 


beeanies 9 


ek 


iJ 


“¢ 
é 


ui [stot 


hoe] 
1 ER 


oil 


few 


© or 
re ¢) 
=" 
<f m3 
é Ne 
= 5 
{} m 
= = 
ae 
_ ret 
son 
wt 


C43 
7D 


ted 


os 


tant 
tar 


aj 


t e@inab 


Bh 


OE. 


el 


* 
t 


TUATS 


ps7 


oO 


ntyolqsb 


whe - 
HiTa 


PN Oey ES el Fe A BOO a A el Re LN Pl Al 


>) 


cE, 


CF 


S 


a) 
7) rd 


CONFIDENTIAL 


~ 


re pe 


a ot 


- 


e 





€ eTqel 


6°99 PpelZL Z°P9 9°h8  €°8S O0°0S 6°2S 2°9F 2°99 6'OF 
91 l LI eT 9¢ 0z LI 92 6 wa 
870° 9620° 2990° 66£0° 8ffT° B8ISO’ PE90' 9FFO' 80S0° 2890° 
e C et Il Iz OI 6 ZI 9 6 
“2° VE Z 6G loz cee L°LE PPR 6°PE P'Ie§ 2°se Gop 
-L°S9 8°09 6°45 S‘€9 Saco, 9°SS “Toso. ‘OS -987 Voupe e° og 
- 96 601 OzI 6ST S6 PSI 9 eZl «#9 OZ 
- PEt 691 Sol 912 Ta SEI Zr 692 SII Zou 
79 €9 19 ep LP Pe ie 61 91 PI 
VAD 


yOd ut 


onan em 


aaa ae = 


juawAOTdO 
uO paIINdVO 


an ae 


1eU} SJUSPTOO? 


~~ 2 & 


JO JUDIE 


~ 


-~ 


s]UepIOoY 
jo Jequinu [eI], - 


~ 


~ 


~ 


sep Butje18do : 


~ 


~ 


a 


a wr ea uae 


I9TLIeO /SUsptooy 
JO Joquinyy >> - 


poAojdaep 


~ 


“~ 


~ 


~ 


anmaan ee 


aTIuUmM sUSpToOoOY 
JO Jequinyy > ~: 


~ 


~ 


ate a a = 


eos je 


QUIT] JUSDIEdg 


wod ut sAeq 


sAeqg 


Hut e1edO Jetueg 


QUT} JUDDIO4 


= 


~ 


CONFIDENTIAL 


cO 
— 





i | +, yd ¥yvV) 
> 3 ° o 
my 9 ’ oO. a ’ 
‘ 
¥ 
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The period of time during a deployment in which accidents are most 
likely to occur would be valuable information if it could be accurately pre- 
dicted. However, many complex variables such as weather, type of opera-~ 
tions, proficiency of all involved personnel and many other operating condi- 
tions present themselves. 

Figs. 4a and 4b represent the deployments for 1962 and 1963 for the 
CVA's operating with the SIXTH and SEVENTH FLEETS. 

In general, most of the accidents occurred within the first two months 
and gradually declined as the cruise progressed, which is reasonable since 
the pilots and carrier personnel become more proficient with time. However, 
a definite rise occurred in both fleets toward the end of the deployment 
periods. This rise started after about four months for the SEVENTH FLEET 
and after about six months for the SIXTH FLEET. Sufficient data was not 
available to accurately account for this rise in accidents. In general, the 
two fleets appeared to suffer accidents in a similar manner on deployment. 
The K-S(Kolmogorov-Smirnov) test indicates no significant difference in the 
cumulative percentage distributions for the two fleets at the .01 level. The 
largest difference occurred at 180 to 210 days as the number of accidents 
in the SIXTH FLEET showed a rise where the SEVENTH FLEET showed a 
slight decrease. 

Figs. 5a and 5b show accidents as a function of the number of days 
at sea since beginning the deployment. Both fleets experienced amode 
at less than 20 days, which includes the period enroute to the area of 
deployment. Other sample modes appear at similar times for the two 
fleets, but the general pattern decreases with time. It has been shown 
that the carriers spend between 60 and 70 percent of their deployed time 


at sea, including the enroute time. For a normal length cruise of six to 
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: oe nie ; ee ged ey 2 an 393 fs) yO as 
to seven months’ on stafion ,;the cruise woyldverminate after 120 to 140 


rao 3 »y YyrY 


operating days. The SIXTH FLEET had a positive ae of Mee eae occur- 
rence during this time, while the SEVENTH FLEET experienced a continued 
decrease, although at a lesser rate. 

The K-S test again shows no difference in the cumulative percentage 
distributions for the two fleets at the .01 level of significance. The 
largest difference in the distributions for the two fleets occurred at 120 


to 135 days. 
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X-Scale=Days x 10 


Y-Scale=Accidents : a 
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Fig. 4a. Time since beginning of deployment until accident, . 
6th FLEET 
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X-Scale=Days x 10 


Y-Scale=Accidents 
Fig. 4b. Time since beginning of deployment until accident, 
7th FPEBET . 
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X-Scale=Days x 10 
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Fig. 5a. Time at sea since beginning of deployment until 
accident, 6th FEEET. 
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X-Scale=Days x 10 
Y-Scale=Accidents 


Fig. 5b. Timé at sea since beginning ofvdeployment until 
accident, 7th FLEET. 
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8. Length of Time as Soa. Ptior - to"Acgient}. 3°06 Ul i 


Analysis of the occurrence of accidents during operating periods indi- 
cates that most mishaps were recorded within the first five days at sea for 
both fleets. Fig. 6a shows this frequency of occurrence for the SIXTH 
FLEET. With an average time spent at sea of 9.59 days, a mode occurred 
at five days. Afterwards, the rate decreased sharply to ten days and then 
continued to decrease at a lesser rate. The SEVENTH FLEET, with an 
average time spent at sea of 9.97 days, also experienced a mode at five 
days as shown in Fig. 6b. However, almost as many accidents occurred 
between five and ten days at sea as within the first five days. The distri- 
bution of accidents after ten days at sea for both fleets showed a decrease 
because the number of periods at sea was less than ten days on the average. 

The K-S test on the two cumulative distributions showed that the two 
distributions did not differ significantly at the one percent level. The 
largest difference occurred during the period from one to five days, with the 
SIXTH FLEET having the higher percentage. The manner in which flight opera- 
tions are conducted during the first few days out of port varies with the fleet 
involved, the length of the in port period, and the particular operating require- 
ments. 

In order to examine the effect of the length of in port periods on the num- 
ber of days out of port until the accident occurred, sample correlation coef- 
ficients were calculated for these two variables. If the true nature of ac- 
cident occurrence were such that the longer a ship remained in port the sooner 
the accident would occur after putting to sea, the expected correlation should 
approach -1.0. The calculated correlations do not conform to this theory. The 
SIXTH FLEET sample correlation coefficient of .408 indicates a positive re- 
lationship between length of time in port and length of time at sea prior to 
an accident. The SEVENTH FLEET sample correlationwas -.065. In this 


case the correlation was negative but was very near ZETO. Por aes sample 
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sizes, the pence ‘colrelaniommecente: exit hecomes ‘asyriptdtically. normal. 
Under this assumption a two tailed test of the hypothesis that the true 
SEVENTH FLEET correlation is zero resulted in acceptance at the .05 signi- 
ficance level indicating that the two variables may be considered independent. 
The difference in the two correlation coefficients is partially explained by 
noting that the distributions of the number of days at sea prior to an acci- 
dent for both fleets are not significantly different, while the distributions 
for the length of in port periods were shown to differ at the .01 significance 


level. However, no intuitive reason is apparent to justify this difference. 
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X-Scale=Days 
Y-Scale=Accidents x 10 
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Fig. 6a. Time at sea immediately prior to accident, 6th FLEET. 
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Fig. 6b. Time at sea immediately prior to accident, 7taeeienL Te 
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9. Phase of Cpecartion. 7 ae ; oe oF io _ 4 is: 

A breakdown of aircraft accidents into the oneee of BD eT atioae during 
which the accident occurred is shown in Figs. 7a, 7b and 7c. Almost 49% 
of the 300 combined fleet accidents happened during the landing phase and 
60% occurred either during the landing or waveoff. Takeoff and inflight 
accidents were nearly equal at about 17% each. Fig. 7a shows these distri- 
butions. 

Of the 70 SIXTH FLEET accidents, the largest number also occurred 
during landing, Fig. 7b. Thirty-seven percent were landing accidents and 
46% were either landing or waveoff, which shows a reduction compared to the 
combined fleets. However, 27% of the accidents occurred inflight and almost 
22% happened on takeoff. 

The SEVENTH FLEET, Fig. 7c, followed the same pattern with 48% of 
the accidents occurring during the landing phase and 64% either landing or 
waveoff. Takeoff and inflight accidents accounted for 18% and 14% respec= 
tively. 

In general, most of the accidents occurred during landing with the 
SIXTH FLEET having the least percent in this phase. The second most com- 
mon phase of accident occurrence was inflight, and the deployed fleets 
showed an increase over the combined fleets. Static and taxi phases ac= 
counted for approximately 5% in all cases. 

In order to compare the fleets a likelihood ratio test was constructed 
for the combined landing and waveoff phases, which accounted for most of 


the accidents. The results for the combined fleets and the SIXTH FLEET 


-y . S. Naval Aviation Safety Center. Manual of Code Classifications 


for Navy Aircraft Accident, Incident and Ground Accident Reporting, 
July, 1963: 29-38. 
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showed a sionificant différence at tive .05, lever with"th® SIXTH: FLEET 
having the fewer accidents in ane Seco The SEVENTH FLEET com= 
pared favorably with the combined fleets showing no difference at the 
.05 significance level. A comparison of the SIXTH and SEVENTH 
FLEETS showed significant difference at the .05 level with the SIXTH 
FLEET again having fewer accidents in the landing and waveoff phases. 
A comparison of the combined, SIXTH and SEVENTH FLEETS acci- 
dent phase distributions was made for all the phase types using the two- 
sample K-S test. Although designed for continuous data, this test 1s 
applicable to discrete distributions such as those shown in Figs. 7a, 
7b and 7c. [3]. A significant difference exists between the combined 
fleets and the SIXTH FLEET, and also between the SIXTH FLEET and the 
SEVENTH FLEET at the .1 level. The phases of maximum difference were 
inflight, where the SIXTH FLEET had more accidents than the other two, 
and landing, which showed the SIXTH FLEET with fewer accidents than the 
SEVENTH FLEET or the combined fleets. 
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X-Scale: 0=Undetermined . 
1=Static, incident to flight 
2=Taxiing, incident to flight 
3=Takeofft ss 
4=Inflight ‘ | 
5=Landing 
6=Waveoff 
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Fig. 7a. Phase of operation, Combined Fleets. 
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X-Scale: 0=Undetermined > | 
_e@lsbtatic «incident to Aight | 
2=Taxiing, incident to flight ; 
_ 3=Takeoff 
4=Inflight 
5=Landing 
6=Waveotfft 
Y-Scale=Accidents x 10° 
Eig 7D. Phase of operation, 6th FLEET. 
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X-Scale: 0=Undetermined 
1=Static, incident to flight 
2=Taxiing, incident to flight 
3=Takeoff | 
4=Inflight : : 
5=Landing 
6=Waveofft 


Y-Scale=Accident x 10 
Fig. 7c. Phase of operation, 7th FLEET 
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10. Accident Damage and, GVayse Factcrs © . e 4 
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Figs. 8a, 8b and 8c present aircraft accidents as a function of pilot 
injury, aircraft damage and selected cause factors for the various fleets. 
Fatal injuries are those resulting in death within 30 days after the accident. 
Unknown injuries are those in which the remains were not recovered. Air- 


craft accident damage is defined as fone 


ALFA-Destruction, loss or damage to the aircraft which renders 
the aircraft of no further value except for possible salvage of 
parts. .. This classification does not include repairable aircraft 
which must be surveyed because of inaccessible location, cur- 
rent limitations on manhours or funds allowable for the repair 

of the aircraft, or aircraft is striken for other administrative 
reasons. 


BRAVO-Aircraft damage sustained which is so extensive that 
a standard rework at an O & R facility or at a contractor's plant 
is necessary to restore the aircraft to serviceability. 


CHARLIE-Aircraft damage sustained which does not necessitate 
a standard rework. . . when (1) The total direct manhours re- 
quired to effect complete repairs to the aircraft exceeds the 
minor damage limits established for the various models of air- 
craft as listed in enclosure (5) of (OPNAVINST 3750.6E). 

(2) Destruction or damage beyond economical repair to a major 
component requiring its removal and replacement with a new 
component. 


During the two year span of this study, 69 accidents in the combined 
fleets resulted in fatal or unknown injuries. Thirty three percent of these 
occurred in the SIXTH FLEET and 35% in the SEVENTH FLEET. One acci- 
dent in three resulted in fatality in the SIXTH FLEET while the SEVENTH 


FLEET suffered one in four on the average. 


ey -9. Naval Aviation Safety Center. Manual of Code Classifications 


for Navy Aircraft Accident, Incident and Ground Accident Reporting, 
lily; 196323. 
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Aircraft damage for each of the fleets shows BRAVO damace a fess uw 
frequent classification in all cases. The K-S test of the cumulative 
percentage distributions for accident classification resulted in no signi- 
ficant difference in the combined fleets and the SEVENTH FLEET at the 
-l level. However, the SIXTH FLEET was significantly different when com- 
pared to the combined fleets or the SEVENTH FLEET at this level. 

Pilots were listed as contributing cause factors in almost half the 
accidents for each of the fleet categories. This indicates pilot's actions 
contributed to the occurrence and extent of damage, and that they were 
not necessarily the sole causal factor. However, these high percentages 
indicate an area which could substantially lower the number of accidents 
if the pilot factor were reduced. 

The extent of ship participation in accident causation was examined 
in three categories. It was found that the LSO was listed as a contri- 
buting cause factor in 11% of the combined fleet accidents, 13% for the 
SEVENTH FLEET and 7% for the SIXTH FLEET. The CVA was reported as a 
contributing factor in 12% of the combined fleet accidents, 13% for the 
SEVENTH FLEET and 9% for the SIXTH FLEET. No significant differences 
existed in these areas between the two deployed fleets or the combined 
fleets at the .1 level. Pitching deck was a cause factor in 6% of the 
combined fleet accidents, 8% of the SEVENTH FLEET, amd none of the 
SIXTH FLEET accidents. Sufficient data was not available for a compari- 
son of the total amount of operations which were conducted under condi- 
tions involving pitching decks and any conclusions concerning a fleet's 


performance under these conditions would not be factual. 


9 


)> >) 9) atk ) > > 
> CONFIDENTIAL 

) $ vu é ¢ 

, Ie oO 

>>») 7 » 4? >>> »»? > 93)? } peed ) 


. ee im 2 , i Op 7) pre 2) yas wD , ) 
) , ) »’ >.>») 

y } >> 3 ) ’>)d) 3 PJ >? d 3 
) d 3 


i : ie 

c Cc | 
' f Gc r 
' C; 


i ' it 
C (es Bie Ge 





CONFIDENTIAL 





G16 


61a 


0G 





X-Scale: 1=Fatalities or unknowns 
2=ALFA damage . 


{ 


3=BRAVO damage 
4=CHARLIE damage | 
5=Pilot as a cause factor 

6=LSO as a related variable 

7=CVA as a contributing cause factor 
8=Pitching deck as a contributing cause factor 





Y-Scale=Accidents x 10 ‘ 


Fig. 8a. Damage and cause factors, Combined Fleets. 
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2-ALFA damage 

3=BRAVO damage ; 
4=CHARLIE damage 

5=Pilot as a cause factor 

6=LSO as a related variable 

7=CVA as a contributing cause factor 

8=Pitching deck as a contributing cause factor 
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X-Scale: 1=Fatalities or unknowns | 


Y-Scale=Accidents x 10 


Fig. 8b. Damage and cause factors, 6th FLEET 
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Fig. 8c. Damage and cause factors, 7th FLEET. ms 
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11. Total Pilot Time. . . =} . . 

The variable discussed in this section and those of the remaining | 
sections have been studied for many years by NASC and are included in 
their annual report which displays the fleetwide picture of aircraft accident 
occurrence. They are of prime importance in depicting the proficiency and 
operational experience levels of pilots involved in accidents. However, 
these variables are members of a set of data which has been subjected to 
much analysis in the past. They have served a useful purpose in providing 
valuable information to initially reduce the Navy's aircraft accident rate. At 
the present, however, the easy and obvious remedies for accident causation 
have been taken, and these variables do not yield the subtle and hidden 
cause factors unless their values are extreme. 

The frequency of total pilot time for pilots involved in CVA accidents 
during 1962 and 1963, Figs. 9a, 9b and 9c, shows a similar trend for each 
of the fleets. The curves rise sharply to the largest mode at 800 and 900 
hours since most of the aviators flying from CVA's on their first tour of opera- 
tional duty have accumulated approximately this amount of pilot time. In 
addition, these first tour pilots in general lack the experience and profi- 
ciency that comes with subsequent tours. The curves decreaSe after the 
first mode, resembling the pattern of rotation of these first sea tour pilots 
to their first shore duty which rarely involves carrier flying. Therefore a 
drop in accidents involving aviators with about 1500 pilot hours is to be 
expected. The SEVENTH FLEET differed slightly in that the decrease from 
the first mode covered a wider range of pilot hours. The second mode repre- 
sents pilots on their second tour of carrier flying and occurred at slightly 
less than 2000 hours. The number of accidents represented by this mode 
is less than the first mode since aviators in this class are uSually more 
experienced in carrier flying. The data as presented here represents only 
those aviators who had accidents, Bue it is Susana Eat a plotiot HOME, 


pilot hours for all CVA pilots would: ‘show riode'’s ay  approyimately the same 
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Total pilot time was analyzed for 1962 and 1963 separately: 


Y 
’ 
‘ 
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sows 


The cumu~’”’ 
lative percentage distributions showed no significant difference in the two 
years at the .1 level when subjected to the K-S two sample test. Each of the 
fleet categories were also tested against the others at the .1]1 level and no 
difference was found to exist. 

No data was obtained for pilots who were not involved in accidents. How- 
ever, under the hypothesis that total pilot time for these aviators is not signi- 
ficantly different from the data shown in Figs. 9a, 9b and 9c, it can be con- 
cluded that total pilot time for aviators involved in accidents is a representa- 
tive sample from the total population of aviators who fly from CVA's. There- 
fore, this variable does not appear to be useful in a discriminatory analysis 
where the objective is to determine functions of certain discriminating vari- 


ables which will lead to prediction of accidents. 
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Fig. 9c. Total pilot time, 7th FLEET. 
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12. Years Military Flying. 7 

The number of aircraft accidents is Shown as a function of years mili- 
tary flying in Figs. 10a, 10b and lOc. This data as collected by the U. S. 
Naval Aviation Safety Center is recorded in integer increments through the 
ninth year. Otherwise it is coded in classes of 10 through 14 years, 15 
through 20 years and over 20 years. Because of this data classification, 
some interpretations of the graphs is necessary. 

As was pointed out for total pilot time, most of the accidents involved 
pilots with approximately five years flying experience. The number then de- 
creased as these first tour pilots rotated to shore duty. This covers the 
period through about the tenth year. Other modes should appear between 10 
and 15 years, however, both the combined fleets and the SIXTH FLEET show 
a continued decrease, although at a lesser rate. The SEVENTH FLEET showed 
a rise during this period. All fleets are characterized by a second mode at 
20 years which should be interpreted as between 15 and 20 years. Integer 
classification of the data through all the years would have made these plots 
more precise. 

The cumulative percentage distributions for each of the fleets did not 


differ at the .1 significance level under the K-S two sample test. 
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Fig. 10a. Years military flying, Combined Fleets. 
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13. Pilot's Rank. 


Analysis of the number of accidents as a function of the rank 
of the pilot follows the general pattern established by the plots of 
total pilot time and years military flying. Figs. lla, llb and llc show 
that most of the accidents involved pilots of the ranks of LT and LTJG, 
which correspond to the modes at about 1000 pilot hours and one to 
five years flying experience. The rank groups of LCDR and CDR 


show fewer accidents, as did the curves for corresponding total pilot 


999 9 


hours and years military flying. Again, the rank of pilots involved in 


9 
a 


accidents seems to follow the suspected distribution of pilots assigned 


to flying billets aboard CVA's. One exception appears in Fig. llc, 


,o9 9 


where the SEVENTH FLEET recorded more commanders involved in acci- 
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Fig. lla. Pilot rank, Combined Fleets. 
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Fig. llb. Pilot rank, 6th FLEET. 
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14. Pilot Time in Type Aircraft. 

Number of accidents as a function of pilot hours in the particular type 
aircraft was studied for each of the fleet breakdowns. Figs. 12a, 12b and 12c 
represent the various fleets. 

In all cases, a sharp rise occurred in the number of accidents involving 
pilots with less than 200 hours in type. Pilots normally commence a carrier 
tour with more than 50 hours in type since this is usually a requirement of 
the training squadrons. Therefore, the accidents shown for pilots. with less 
than this amount of time can be attributed in most cases to incorrect.data. 

In the few cases where pilot hours in type were either omitted in the-data 
or indicated as less than ten hours, the computer programs for drawing the 
frequency curves interpreted this as zero hours. 2 

A prominent mode existed at about 300 pilot hours in type for each of the 
fleet categories. Afterwards, the number of accidents decreased with in- 
creasing pilot time in type, this drop generally being more gradual, chan the 
initial rise and containing some secondary modes and periods of level off. 
Another mode appeared near 1000 pilot hours in type, and no ocet are 
shown for pilots with more than 1000 hours. It appears that pilots enter a 
danger zone as they approach 1000 hours in type and then are immune’ to ac- 
cidents after passing this threshold. However, the explanation for this mode 
lies in the manner in which the data is coded. Two columns of the osonch 
cards are used by NASC to code pilot hours in type, this data beiag -€Xpressed 
in tens of hours. A pilot having 267 hours in type is coded as 26. "Ree 
scheme, 990 hours is the maximum that can be coded. Of the 300 accidents 
involved in this study, there were ten accidents where the pilot tine in type 
was coded as 99. Since this indicates 990 hours or more, it seems Kean 
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able to expect not a mode, but a continuation of the decreasing ond ‘in this 
area. > 3 ; 
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Figs. l2a, 12b and 12c represent only those pilots that were fying 
from the carriers. In order to detect areas of time in type aircraft where 
accident potential is significant, these plots must be compared with the 
distribution of pilot time in type for all the pilots aboard the CVA's. This 


data was not available for this study. 
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Fig. 12a. Time in type aircraft, Combined Fleets. 
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15. Pilot Time, Last Three Months. - 

Frequencies for the number of pilot hours during the three months prior 
to an accident are plotted in Figs. 13a, 13b and l3c. The curves are similar, 
each having a mode at 50-70 hours with a much smaller mode appearing at 
about 200 hours. Under the K-S test, no significant difference was found 
to exist at the .1 level. The data indicating more than 150 pilot hours in the 
three month period prior to an accident should be viewed with caution. 

A pilot who flies 20 hours per month on the average, as did most of 
those involved in accidents, can be expected to remain at an acceptable 
level of proficiency under normal operating conditions. However, further 
study of the number of hours flown in the last 30 days and the last seven 
days may show areas of potential hazard. It is possible that too much or 
too little flying in a short time span such as a month or even less, can affect 


performance. 
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Fig. 13a. Pilot time last three months, Combined Fleets 
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Fig. 13b. Pilot time last three months, 6th FLEET. : + 
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16. Night Time Last Three Months. 
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Figs. 14a, 14b, and 14c show the night pilot time in the last three months 
preceding a night accident. The total number of night accidents in the com- 
bined fleets for 1962 and 1963 was 128. Of these, 29 occurred in the SIXTH 
FLEET and 42 in the SEVENTH FLEET. Each of the deployed fleets suffered 
41 percent of their accidents at night. Their cumulative percentage distri- 
butions did not differ at the .1 level of significance. Each had a mode at 
15 hours. According to the plots, the average night time per month was be- 


tween five and six hours. 
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17. Areas for Further sree 

The assumption was made in Section 2 that whenever a CVA was reported 
to be at sea, flight operations were being conducted. This is generally true 
for most operating days. However, days of replenishment, restricted ship 
maneuvering and periods of crew rest while at sea make this assumption 
somewhat erroneous. In addition, all flying days are not the same. During 
fleet operations and exercises, the carriers sometimes operate on a continu- 
ous basis for several days, whereas a routine operating day may begin after 
Sunrise and terminate before midnight. Some carriers limit night operations 
on the first night out of port in order to permit pilots to make one day land- 
ing before flying at night. A detailed examination of the type of operations 
that was being conducted when an accident occurred may provide useful 
information in understanding the causes and predicting the occurrence of air- 
craft accidents. 

Certain variables such as the number of pilot hours, instrument hours 
and night hours are collected for the three month period prior to an accident. 
It is possible that these figures could indicate satisfactory performance over 
the entire period while the true statuS was very much different. The situation 
where a pilot flies 15 night hours at the beginning of this period and does not 
fly again at night until his accident, two months later, would non ne detected 
with the present data. Similarly the total number of carrier landings, as pre- 
sently collected, does not provide data concerning a period immediavely 
prior to the accident. This information is usually contained in the body of 


the accident report, but is not coded on the punch cards. Analysis cf opera- 


ms be 
a 


tional performance for a short period immediately prior to an accizen? may 


reveal trends which could be useful in future accident prevention programs. 
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The rise in accidents toward the end of a deployment may be caused by 
many factors. Such areas as increased operating rate and commitments, 
over-confidence and fatigue are recommended for study. Another factor 
which may contribute to accident causation is the port of call. It is well 
known that some ports offer more recreation for the crew than do others. 

A study of the accidents which occur after the carrier leaves a particular 
port may reveal the effects of this factor. 

The variables examined in this study pertained only to those pilots in- 
volved in accidents. A study of the same variables for pilots who did not 
have accidents is recommended. In addition, an analysis of variance may 
produce interesting results in establishing the effects of some of the vari-=- 
ables. 

The data presently collected which describes aircraft accidents has 
been valuable in reducing the occurrence of accidents. However, it is not 
sufficient to thoroughly analyze the underlying causes which do not appear 
in studies such as this. The use of an experimental design modei is recom- 
mended to aid in the determination of meaningful variables which will further 


the progress of accident prediction and prevention. 
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OPNAV ZULU DATA 


Operating data for the units based aboard CVA class carriers was 
Supplied for this study by NAVCOSSACT in the form OPNAV ZULU Reports 
recorded on high density tapes. This data consists of operational and 
maintenance information for every aviation unit presently in commission in 
the Navy, and is compiled in 558 character records, each record covering 
the performance of the unit for a one-month period. The format of the record 
lists the BNEP (Basic Naval Establishment Plan) Code, Command Code and 
Unit Code as identifiers of the units submitting the reports. Since there 
are many aviation units which have the same BNEP and Command Codes, the 
Unit Code must be uSed to select particular squadrons, such as thosewhich 
served aboard CVA's. Once the Unit Code is known, the location of a squad- 
ron can be obtained by a cross check of the Master Locator File for the parti- 
cular month desired. However, the Unit Code undergoes monthly change, 
and in order to utilize the information contained in the OPNAV ZULC 2eports 
over an extended period of time, it is necessary to locate each desired 
Unit Code on the Master Locator File for each month. These Unit Codes 
must then be matched, by month, against the OPNAV ZULU Reports so that 
the proper units may be selected. Although the Master Locator Fiies were 
available for the 24 months covered by this study, time was not available to 
complete this process. 

Since much of the data contained in the OPNAV ZULU Reports is related 
to maintenance and readiness of aircraft, only those portions perta:niiig to 
actual operating performance were desired for this study. An object pro- 
gram was written by Lois Brunner of the USNPGS Computer Facility heen 
will screen and edit the high density OPNAV ZULU Tapes. Output is low 
density 88 character records consisting only of operational data fer 1952 
and 1963 for those squadrons whose BNEP Code indicate CVA operations . The 


output format and program listing are included at the end of this appendix. 
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REVISED OPNAV ZULU FORMAT 


Type 

BN EP Code 

Command Code 

Model Plan Code 

Unit Code 

Model Description 

Month 

Year 

Total Flying Hours 

Total Flights 

Carrier Arrested Landings (Day) 
Carrier Arrested Landings (Night) 
(Day) 

Bolter (Night) 


Bolter 


Flight Purpose Code 
Flights 

Hours 

Flight Purpose Code 
Flights 
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Sob d god APBEMDIEIE PP nr re 
‘COMPUTER PROGRAMS FOR DATA ANALYSIS **' *** 

The USNPGS Computer Facility was used to process the data for this 
study. Programs were written to compute the variables related to ship 
operations, and the graph subroutine on the computer library tape was 
used to draw the graphs. Ship movements were transferred from micro- 
film to data cards by using the numeric code: 

O=Ship not deployed 
1=Ship deployed, in port 
2=Ship deployed, at sea 
A 730 day record was made for each CVA so that the proper variables 
could be computed. The data cards from NASC were used directly as 
input for the computer. However, because of unidentified multiple punches 
in the last six columns of each card, these columns were erased and re- 


numbered. 
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A. PROGRAM THESIS 
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This program computes the following variables related to ship opera- 
tions for each accident: 
1. Number of days at sea immediately prior to accident 
2. Number of days in port immediately prior to accident 
3. Number of days since beginning of deployment until accident 
4 


Number of days at sea since beginning of deployment 
until accident 


5. Number of days in port since beginning of deployment 
until accident 


6. Number of days after accident until deployment is 
over 


7. Number of days since 1 January 1962 until accident 


8. Number of days (regardless of deployed status) between accidents 


If an accident occurred on deployment, all of the variables are computed. 
Otherwise, only certain applicable ones are computed and a note is written 
to this effect. 

Input data consists of the coded ship movements using 80 columns 
of the card, each column representing the status for one day. Since this 
program was written for 730 days, this number appears in the program. 
These ship operating schedules are read into the computer in order of in- 
creasing ship hull numbers. The data for each accident is read from the 
NASC data cards. Routines for the various calculations are explairiéd’ in 
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CONFIDENTIAL 


B. PROGRAM PLOT 

The following two programs draw graphs from the NASC data. The 
nature of each graph is explained by comments in the program listing. 
Input data cards are the sets of three NASC cards per accident. The 
value for N(statement 6) is the number of accidents to be plotted. In 
those cases where the input format is alphabetic, test variables are 
written into the program in "A" fields. The actual data is also read | 
into the computer in "A" fields and tested against the test variables... 
The results of the tests determine the floating point value which wile 


be assigned to the variable. 
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C. PROGRAM PLOT 

The following two programs draw graphs of the data computed in 
PROGRAM THESIS. The graphs are explained in appropriate comments 
in the program listings. Input consists of the computed variables as 
identified in THESIS. N is the number of accidents. The programs 


print the input data as output as a check on the results. 
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Nog etter tenn he baat tata ated Reh a MA ede hee rey at eae pyres ee ape ey, on OY Te tree mean, Wa Sats 
TN Tiedt ba dindd otis Fu hh ek Dh Meh Ak leh Mae Sed Roa a a ne Pa eT ae Para ie ae 7 n n pee : 1ay 

ST leu hedhs te 1s dad ae, aaah teen She) bie.) a ede We te pre Tn i Pee hs Sean (uh wefaee ¥ A ; 5a 
St hc ahh hn Sake cles edi hares hh Wh ih Alia ah Le dal ha Pe ee EO Te ae oS Be ata nae D Ae 
a ek) Ue tad ee Oe ee A he Ok de es ee mer bear dy yep one & 7. 6NRr Bey. Olly e Ot. 8 Yer hem ey tage ete ne the & 58 ey Pree ae oe + ee! 
tal chs tna tla alte th nade Sat hd Reel Lok ge Dee ad Te he ke a ed ee Sree ee i ere me | ; lay 
Pao aga whet Dace did alee MSA aed a eel a eee hetero Pe tt hr err te ok Ty ae rs ee a , ; we < 
Sods rel SC punt kre Ue eae er ct AC ere eS a 
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